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Abstract. Can the cross product be generalized? Why are the trace and de- 
terminant so important in matrix theory? What do all the coefficients of the 
characteristic polynomial represent? This paper describes a technique for 'doo- 
dling' equations from linear algebra that offers elegant solutions to all these 
questions. The doodles, known as trace diagrams, are graphs labeled by matri- 
ces which have a correspondence to multilinear functions. This correspondence 
permits computations in linear algebra to be performed using diagrams. The 
result is an elegant theory from which standard constructions of linear algebra 
such as the determinant, the trace, the adjugate matrix, Cramer's rule, and 
the characteristic polynomial arise naturally. Using the diagrams, it is easy to 
see how little structure gives rise to these various results, as they all can be 
'traced' back to the definition of the determinant and inner product. 



1. Introduction 

When I was an undergraduate, I remember asking myself: why does the cross 
product "only work" in three dimensions? And what's so special about the trace 
and determinant of a matrix? What is the real reason behind the connection 
between the cross product and the determinant? These questions have traditional 
answers, but I never found them satisfying. Perhaps that's because I could not, as 
a visual learner, "see" what these things really meant. 

A few years ago, I was delighted to come across the correspondences 

u X V ^ X and u ■ v ^ ,0, 



in a book by the physicist G.E. Stedman [12]. Moreover, there was a way to perform 
rigorous calculations using the diagrams. 

The central tool in Stedman's book is the spin network, a type of graph labeled 
by representations of a particular group. Spin networks are similiar in appearance 
to Feynman diagrams, but are useful for different kinds of problems. The first 
work with diagrams of this sort appears to be j6j , in which spin networks of rank 
2 were used as a tool for investigating quantized angular momenta. The name 
spin networks is due to Roger Penrose, who used them to construct a discrete 
model of space-time ,9^ . In modern terminology, a spin network represents a graph 
whose edges are labeled by representations of a particular group and whose vertices 
are labeled by intertwiners or maps between tensor powers of representations [7] . 
Predrag Cvitanovic has showed how to construct the diagrams for any Lie group, 
and actually found a novel classification of the classical and exceptional Lie groups 
using this approach [2]. 
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The applications of spin networks are numerous. They are a standard tool used 
by physicists for studying various types of particle interactions [2J. Their general- 
ization to quantum groups forms the backbone of skein theory and many 3-manifold 
invariants. In combinatorics, they are closely related to chromatic polynomials of 
graphs, and Louis Kauffman has posed the Four- Color Theorem in terms of spin 
networks [4j . Spin networks also play a role in geometry. They can be used to char- 
acterize the character variety of a surface, which encodes the geometric structures 
which can be placed on the surface [TUl HI [TT] . There are indications that they may 
also be a powerful tool for the study of matrix invariants. 

Amidst all these applications, there 
is a surprising lack of the most basic 
application of the diagrams: linear al- 
gebra. In this paper, spin networks 
are additionally labeled with matrices 
and called trace diagrams to emphasize 
this application. Trace diagrams pro- 
vide simple depictions of traces, deter- 
minants, and other linear algebra fare 
in a way that is mathematically rigor- 
ous. The paper concludes with an ele- 
gant diagrammatic proof of the Cayley- 
Hamilton Theorem, which follows di- 
rectly from the diagram in Figure [1] 

The emphasis of this paper is on il- 
lumination rather than proof, and in 
particular on how diagrammatic tech- 
niques have the power to both prove 
and explain. For this reason, several 
examples are included, and more en- 
lightening proofs arc preferred. While diagrammatic methods may seem unfamiliar 
at first, in the end they offer a profound insight into some of the most fundamental 
structures of linear algebra, such as the determinant, the adjugate matrix, and the 
characteristic equation. 

We hope that by the end of the paper the reader is both more comfortable with 
the appearance of diagrams in mathematics and convinced that sometimes, in the 
words of Richard Feynman, "these doodles turn out to be useful." 

2. Symmetry in Linear Algebra 

Perhaps the greatest contribution of diagrams is there ability to capture sym- 
metries inherent in linear algebra. This section reviews some of those symmetries 
as well as multilinear or tensor algebra, the algebraic framework used to interpret 
diagrams. 

The inner product is an example of a symmetric (or commutative) function, since 
u • V = V • u. Similarly, the cross product is anti- symmetric (or anti- commutative) 
as u X V = ~v X u. Both functions are multilinear, since they are linear in each 
factor. For example: 

(u + Av) X w — u X w + A(v X w). 




Figure 1. Trace dia- 
gram which simplifies to 
det(A)/. 
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Multilinear functions on vector spaces can always be considered as functions on 
tensor products. Informally, a tensor product of two complex vector spaces consists 
of finite sums of vector pairs subject to the relation 

(Au, v) ~ A(u, v) = (u, Av) 

for A g C. The corresponding element is usually written u (g) v. If = C'^, then 
the domain of both • and x can be taken to he V ^ V, so that ■ : V (S^V ^ C and 
X : V (^V V. For a rigorous construction of tensor products, see Appendix B in 

m- 

As another example, the determinant function can be written as a function 
det : V ^ V ® V — > C, with u (g) v (g) w i-^ det[u v w]. The multilinearity of 
the determinant is usually described as being able to factor the multiplication of a 
matrix column by a constant outside a determinant. Since switching columns in a 
matrix introduces a sign on the determinant, the determinant is an anti- symmetric 
function. 

3. A Taste of Trace 

This section presents 3- Vector Diagrams and Trace Diagrams informally as 
heuristics to aid in calculations. The ideas introduced here will be made rigor- 
ous in the next section. 

Consider again the correspondences 

u X V ^ X and u • v ^ [\ . 



These diagrams are read "bottom to top" so that the inputs u and v occur along 
the bottom, and the output(s) occur along the top. In the case of the cross product, 
a single output strand implies a vector output; in the case of the inner product, the 
absence of an input strand implies a scalar output. 

The notation permits an alternate expression of standard vector identities: 

Example 3.1. Draw the identity 

(u X v) ■ (w X x) = (u • w)(v • x) — (u • x)(v • w). 

Solution. Keeping the vector inputs in the same order, the diagram is: 



uvwx uvwx uvwx 

Exercise 3.2. What vector identity does this diagram represent? 



U V W U V w 



The reader is encouraged to guess the meaning of the fourth term (later described 
in Definition 14.11) . 



Now suppose that matrix and vector multiplication could also be encoded dia- 
grammatically, according to the rules 



ABC ^ CSbcD = ^ and v'^^lw ^ (i). 
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Then matrix elements may be represented diagrammatically as well. If the standard 
row and column bases for C" are represented by {e*} and {ej}, respectively, then 

i 

j 

Using this notation, trace and determinant diagrams may also be constructed. 
Example 3.3. Find a diagrammatic representation of the trace tr{A). 
Solution. 

n i 

tr(A) ^^(i). 

2—1 i 

Example 3.4. Find a diagrammatic representation of the determinant 

(1) det(A) = ^ sgn(cr)ai„(i)a2^(2) • • •a„^(„). 

o-es,. 

Solution. One approach is to introduce new notation: 

12.." 



ctGE 

i z 't 

where 1 1 | represents a permutation on the n strands. For example, if n = 2, then 

12 12 

det(A) 

12 12 

4. Topological Invariance: No Rules, Just Right 

What if there were a set of rules for manipulating the diagrams that was com- 
patible with their interpretations as functions? This section exhibits just such a 
correspondence, which exists provided the graphs are given a little extra structure. 
Several classical proofs become trivial in this context, as the complexity is funneled 
from the proof into the construction of a diagram. 

The diagrams will essentially be given the structure of a graph whose vertices 
have degree 1 or n only, and whose edges are labelled by matrices. But there are a 
few difficulties with ensuring a diagram's function is well-defined. First, 

(2) = u . (Av) = (A^u) • V but in=(Au).v. 



The problem here is that j ^ and ^ j are indistinguishable as graphs, but represent 

different functions. This problem will be resolved in Definition 14. II bv requiring the 
graphs to be oriented. 
The second problem is 

(3) X. = V eg) w but 
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This time, the problem is that the ordering of edges at a vertex matters, so the 
diagram must include a way to order the edges adjacent to a vertex. 

These two extra pieces of structure are incorporated into the formal definition 
of a trace diagram: 

Definition 4.1. An n-trace diagram is an oriented graph drawn in the plane with 
edges labeled by n x n matrices whose vertices (i) have degree f or n only, (ii) are 
sources or sinks, and (iii) are labeled by an ordering of edges incident to the vertex. 

If there are no degree 1 vertices, the trace diagram is said to be closed. Otherwise, 
the degree 1 vertices are divided into ordered sets of inputs and outputs. These extra 
structures determine equivalence of the diagrams under isotopy. By convention, 
trace diagrams are typically drawn with input vertices at the bottom of the diagram 
and output vertices at the top. 

A simple way to maintain the required ordering is to draw a short mark between 
two edges at the vertex, called a dilation. For example, the ciliation on implies 

4 

the ordering ^^3. Diagrams are unchanged under any isotopy which preserves 

1 2 

the order of the inputs and outputs as well as the position of the ciliations. Thus 



holds automatically since the diagrams are isotopic. 

The functional interpretation of a diagram is described in the following theorem: 

Theorem 4.2 (Fundamental Theorem of Trace Diagrams). Let y = C". There is 
a well-defined correspondence between trace diagrams with k inputs and l outputs 
and Junctions V^^ . In particular, every decomposition of a trace diagram 

into the following basic maps gives the same function ( or scalar if the diagram is 
closed): 



T T 



1=1 



: V ® w I — > V • w; 

J'^J^''^^^^ : vi • • ■ v„ I — > det[vi • • • v„] . 

In addition, the n-vertex with opposite orientation represents the determinant of 
several row vectors. 

The decomposition assumes the diagram is in 'general position' relative to the 
vertical direction, and involves "chopping" the diagram up into these particular 
pieces. Vertical stacking of diagrams corresponds to the composition of functions. 
Several examples follow. 
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Example 4.3. To compute switch the order of the outputs: 



Exercise 4.4. Show that / V : 1 ^ dim(y) = n 



Thus, the basic loop is equivalent to the scalar n. Here is the simplest closed 
diagram with a matrix, and the reason for the terminology 'trace' diagram: 

Example 4.5. Show that (^^^ = tr(A). 

Decompose the diagram (^^^ — -f^ ° ^ ° Then 



Solution. 



n 



1 M ^ e, ® e' hU ^(Ae,) I ^(.4e,) • e, ^ a,, tr{A). 

i i i i 

Exercise 4.6. Show that ([2]) is no longer a problem, since : i — > (Av)^. 
Example 4.7. Compute j 

Solution. r\j ~ i since the decomposition Hj" = ■f^ ° ^kj gives 



This last result was expected since both |y' and j, are equivalent forms of the 
same trace diagram. Moreover, this fact essentially proves Theorem l4.2l 

Sketch proof of Theorem \4-S\ ( adapted from [lOj ). The previous example shows that 
isotopies changing the number of local maxima and minima of the form \^ and 
do not change the function. Thus, a trace diagram may be assumed to be posi- 
tioned with the minimum possible number of cups and caps. With this restriction, 
there is only one way to decompose a map into the component maps given in the 
theorem. □ 

Remark 4.8. The correspondence between diagrams and functions established by 
the Fundamental Theorem of Trace Diagrams demonstrates an equivalence of cat- 
egories and is well-known in literature on spin networks. It is usually proven by 
showing that the algebra of diagrams modulo specific relations is equivalent to the 
algebra of functions modulo their relations [12j . 

Remark 4.9. In particular cases, the diagrams can be simplified somewhat. 
• If n is odd, then the determinant is cyclically invariant: 

det[vi •■• v„]=det[v2 ■ • • v„ vi], 

so the ciliation is unnecessary; the cyclic orientation implied by the drawing 
of a diagram in the plane is sufficient. 
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• For 2-trace diagrams, the orientation is unnecessary, and frequently the cap 
is defined to be v (g) w i— s- z • det[v w] rather than the inner product. 
With the factor of i, there is no need to keep track of cihations, and the 
diagrams are simply collections of arcs and loops labelled by matrices [1] |4] . 

5. Simplifying Diagrammatic Calculations 

Theorem 14.21 says that a function's diagram may be computed by transforming 
the diagram into some sort of "standard form." In practice, it is better to have a 
working knowledge of the functions of the few basic diagrams described next. This 
is abundantly clear in the following computation: 



Example 5.1. Show that the diagram /t\ is the function v i-^ — 2v. 



Solution. Arrange the diagram so it decomposes into the basic component maps. 
Then: 




' efc 



det[v Gi ej]det[e^ e' e'^J^e^; 



But 

det[v Gi ej]det[e-' e' e*] 
Therefore, 



det 




1 



V ■ Gj V • Gfc 

1 




-V • Gfe 



-Vk- 



O ■ E {~Vk)ek = -2 ^ UfeGfc = -2v. 

T i¥'j,j¥'k,i^k k 

Fortunately, there is an easier approach. The remainder of this section gives 
several results that make such technical calculations unnecessary. Several of the 
proofs are deferred to the appendix. 

Proposition 5.2. The n-vertices of trace diagrams are antisymmetric, meaning a 
sign is introduced if either (i) two inputs at a node are switched or (ii) a ciliation 
is moved across an edge. Alternately, if any collection of inputs at an n-vertex are 
linearly dependent, the diagram evaluates to zero. 

Proof. These facts are restatements of standard facts regarding the determinant: 
switching two columns introduces a sign, while the determinant of a square matrix 
with linearly dependent rows or columns is zero. □ 

Proposition 5.3 (Matrix Invariance). Matrices may be 'cancelled' at any node 
with the addition of a determinant factor. In particular. 



where A = A 




det{A) 




= det{A) 
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Proof. Topological invariance implies that only one case need be checked: 

(^^^^^ : vi (g) ■ ■ ■ (g) Vn 1-^ det[Avi • • • Av„] = det(A)det[vi • • • v„]. 

The second relation follows from the first. □ 

The next two propositions, whose proofs are found in the appendix, give the 
functions at a diagram's nodes: 

Proposition 5.4. The following diagram is a "complemental antisymmetrizer" : 

(4) V^:6ai 6a, ^ J2 sgn(a|a)e"('=+i) ® ••■(^e'^("), 

where the sum is over permutations on the complement of {ai, . . . , a^} and 

sgn(Q;|(T) = sgn (ai ■•■ Q!fecr(n) ••■ a{k + I)) . 
One important special case is the codeterminant map 

(5) • ^ X! sgn((T)e^(i) (g) • ■ • (g) e^(„). 

Note that sgn{cr) ~ (— l)Lf Jsgn((T) since [^J swaps are required to reverse the 
order of a permutation on n elements. 

Remark 5.5. Proposition 15.41 shows that there is a way to define a "cross product" 
in any dimension, although n — 1 inputs are required. In particular, extends 

U V 

to the family of diagrams 




ai ELi a„_i 



Proposition 5.6. Let denote the antisymmetrizer on k vertices defined by 



: ai (g) ■ • ■ afe I — > ^ sgn(cr)a^(i) (g) ■ ■ ■ (g) a^^k)- 



If k > n, then = 0. Otherwise, for < k < n, 



(-l)LtJ 
TITT (n-fc)! 

In particular cases: 
(6) 

^=(-l)LfjQ = (-l)LtJn! X|s. .l = (-l)LtJn!det(^). 
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6. The Elegant Adjugate and Clandestine Cramer 

We now turn to the main results of this paper, the diagrammatic proofs of the 
adjugate formula, Cramer's Rule, and the Cayley-Hamilton Theorem. For each, we 
will first establish the diagrammatic result, and later show that the diagrammatic 
relation is equivalent to its standard expression via linear algebra. 

The diagrammatic version of the adjugate formula adJ(A) • A = det{A)I is 

Proposition 6.1 (Diagrammatic Adjugate Formula). 
(7) -9= (-l)LtJ(n- l)!det(A) 




Proof. Use Propositions 15.31 and 15.61 □ 

Cramer's Rule is actually 'hiding' in this diagram. Recall that if A = [ai a2 ■ • ■ a 
then Cramer's Rule states that the elements of the solution x are given by 

det(^j) det[ai ••• aj-i b aj+i ■■■ a„] 
" det(yl) " d^t{A) ' 

where Aj is, as shown, the matrix obtained from A by replacing the jth column 
with the vector b. 

Proposition 6.2 (Diagrammatic Cramer's Rule). Suppose that the columns of Aj 
are identical to the columns of A, except that the jth column of Aj is x. Then 



(8) *^'v^= (-l)LtJ(n- l)!det(A) 1 




Proof. By Propositions 15.31 and 15. 6[ 



(9) det{A,) = ^^^^ ^ = -^^^^T)! ^' T - det(A) | = det{A)x. 



The second step follows from the fact that AjCj = b = Ax and the following lemma: 




Lemma 6.3. Let |j represent the linear function mapping ej i— > and i— > 1 for 

i ^ j. If the matrix Aj is any matrix obtained by replacing the jth column of A by 
an arbitrary vector, then 
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Proof. The first statement holds because A&i — Aj&i unless i — j, in which case 
both diagams evaluate to zero. For the second statement, note that if two strands 
adjacent to a single node are labeled with the same vector, then the diagram eval- 
uates to zero. Consequently, 




Combined with the first statement, this proves the second. 



□ 
□ 



It should be clear from [9] that Proposition ([8]) implies establish Cramer's Rule, 
but it may not be clear where the adjugate matrix shows up in Proposition 16.11 
In traditional texts, the adjugate matrix is constructed by (i) building a matrix of 
cofactors, (ii) applying sign changes along a checkerboard pattern, and (iii) trans- 
posing the result. 

In contrast, the diagram adj(yl) is quite simple: 

Proposition 6.4. The matrix elements of ad] (A) may be expressed as 



(adJ(A)), 




Proof. The matrix element of the diagram must somehow encode all the traditional 
steps required for computing the adjugate. But how? First, 'crossing out' occurs 
when the basis elements and are placed adjacent to the nodes, sign changes are 
encoded in the orientation of the node, and the transpose comes into play because 
the matrices in the diagram are along downward-oriented strands. 

Formally, note that the signed (i, j)-cofactor may be expressed as the determi- 
nant of the matrix 

• ■ • ain 



Aj = [ai • • • aj_i e,: a^+i 



On 



an 



a-ni 



• • • Uji 



in which the jth column of A is replaced by e^. By definition, {ad]{A))ji = det{Aj). 

The following equation, which is remarkably similar to ([9]), shows how to find 
the adjugate matrix: 



(10) 



{adi{A))ji = det{Aj) = 



(n-1)! 



(n- 1)! 




This establishes the result. 



□ 
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7. The Not-So-Characteristic Equation 



Recall that p(A) = det(A — XI) is a degree n polynomial in A, called the char- 
acteristic polynomial of A. By the fundamental theorem of algebra, it must have 
n real or complex roots, counted with multiplicity, which are the eigenvalues of A 
leading to the equation Av — Av for some eigenvector v. The Cayley- Hamilton 
Theorem says that a matrix satisfies its own characteristic equation p{A) = 0. For 
example, in the case A — [45], the characteristic polynomial is 



det(^ - XI) = X^ - (trA)A + det(A) = A^ - 7A - 2, 



"2 


3 


2 


7 


2 


3' 




'l 


0' 







0" 


4 


5 




4 


5 


- 2 





1 











and consequently 



Our final result is actually the most trivial, an immediate consequence of Propo- 
sition 15.61 

Theorem 7.1 (Diagrammatic Cayley-Hamilton Theorem). If l|' +"| represents the 
anti-symmetrizer on n + 1 vectors, then 




(11) 



But how does this not-so- characteristic version of the characteristic equation 
relate to the formula det(^ — A/)? 

Proposition 7.2. When the anti-symmetrizer |n + 1 in (llip is expanded, the co- 
efficients of A' are equal to nl times the coefficients of A* in the characteristic 
polynomial det{A — XI) = 0. 

As a first step, here is the determinant of a sum of matrices: 

Lemma 7.3. Given A, B Mnxn, the determinant sum det{A + B) is expressed 
diagrammatically as 

det(A + B) -- 



Proof. Replace A in det(A) 




The result consists 



of 2" diagrams, each of which has the form 



where ? is either A ov B. 



The matrices in each summand may be reordered without introducing any signs, 
since any 'switch' at the lower node must also be made at the upper node. So the 

terms may be grouped by the number of S's in each. Since there are y \ with i 



B strands, the result follows. 



□ 
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(12) 



Consequently, the characteristic polynomial is 

(-l)LfJ " 



det(A-A/) = ^-^^ (-1)^ 



i=0 




This means that the coefficients of the characteristic polynomial are, up to a con- 
stant factor, the n + 1 "simplest" diagrams with nodes. 

The next lemma provides a combinatorial decomposition of the anti-symmetrizer 
in (HH): 

Lemma 7.4. For any k with < k < n, 



(13) 





Proof. Let a G "^k+i be a permutation, and decompose it cr = tv, where t is the 
cycle containing the first element and v contains the remaining cycles. If |t| = z + 1 
is fixed, then there are choices for r and therefore kl total choices for each 

value of i. Since sgn(r) — (—1)' and sgn(zy) is incorporated into | | , the coefficient 

ofAMs (-l)^(^. 



□ 



Proof of Proposition \7.'2\ As indicated in , the coefficient of A* in the charac- 
teristic polynomial is 



(_l)*+LtJ 




(14) 



On the other hand, letting /c = n in Lemma l7.4l and applying Proposition lS. 61 shows 
that 




A' 



The coefficient in the last sum is rtlc^, so Equation (|11[) is n\ times that given by 
the Cayley-Hamilton Theorem. □ 



Closing Thoughts 



The results contained in this paper are just a start. It is an easy exercise to 
flip through a linear algebra textbook and find more results than can be expressed 
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diagrammatically. Conversely, every diagrammatic relation has a linear algebra 
interpretation, so they are quite good at "generating" new formulas. 

As one final example, trace diagrams are remarkably good at capturing the con- 
cept of a matrix minor. Using this fact, Steven Morse has shown 8 that both the 
Jacobi Determinant Theorem and Charles Dodsgon's condensation method for cal- 
culating determinants have simple diagrammatic proofs. The Jacobi Determinant 
Theorem is 




and the condensation technique arises from the special case k = n — 2. 

Trace diagrams are a powerful technique for generating trace identities, which 
suggests that they may in the near future be used to solve problems in invariant the- 
ory that are intractable with classic techniques. Indeed, for n matrices {Ai, . . . , An} 
it is an immediate consequence of Proposition 15 . 61 that 





This equation, which generalizes the characteristic equation, is sometimes called a 
polarization of the characteristic polynomial, and is the source of all trace identities 
for certain matrix groups. 



Appendix A. Proofs of Node Identities 
Proposition A.l (Proposition 15 .4p . 




J2 sgn(a|a)e'^('=+^) ® ■•■«)e'^("\ 



where the sum is over permutations on the complement of {ai, . . . , a^} and 

sgn(Q;|(T) = sgn (ai ■•■ afc(T(n) ■•■ a{k + 1)) . 
Proof. The function is computed by redrawing the diagram 




The cups transform an input (g) ■ • ■ (g) ea^, to 

e^i ® • • • ® (e^(„) ® • ■ • e^(fe+i)) •» (^e'^^'+i) «)■•■«) e'"'"') . 
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The summation is restricted to the complement of {ai} since the determinant of 
any matrix with repeated columns is zero. Hence, it may be rewritten 



.^'^('=+1) 6?) . . . 6?) 



and the determinant evaluates to the sign defined above. □ 

Proposition A. 2 (Proposition 15. 6|) . If k > n, then J = 0. Otherwise, for 
<k <n, 

(n-fc)! 



Proof. The fact that — for k > n follows from Proposition [521 




For k < n, the function is computed by applying Proposition 15.41 twice. The 
image of e^^ ® ■ ■ ■ ® Gq,^ is 

X! X! sgn(ld|(7)sgn(CT|r)e^(i) ® • • • ® e^(fc) 

Reversing the permutation in the sgn(CT| r ) term gives: 

sgn(ld|CT)sgn((T| t) = (— l)LtJsgi-i(|d|^)sgn(T|(7) 

^ (-l)L?Jsgn(^)2sgn(/3)2sgn(T) 
= (-l)LtJsgn(T). 

Here /3 is a permutation that encodes the ordering of {a^} and its complement, 
which is assumed to be consistent throughout the computation. Therefore, 



e„, (g) • ■ • I — > > > (-l)!-? Jsgn(r)eT-(i) (g) ■ • ■ (g) e^(fe) 



E E 



= (-l)L'2J(n-/c)! 2J sgn(T)e^(i) (8)---®e^(fe). □ 
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